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Abstract 

Background: In Singapore, SingHealth Polyclinics (SHP) is an accredited Family Medicine (FM) training centre which 
managed 1.8 million primary care patient-visits in 2012. To promote research in the institution, research 
consultation clinics (RCC) are being introduced in 2010 to enable free face-to-face consultation between 
experienced and novice researchers on specific research topics. Each RCC session allows about an hour or more for 
the SHP staff, medical undergraduates and general practitioners to seek advice and clarification on key research 
areas, ranging from research question refinement, study design and execution, data analysis, result presentation to 
publication. The consultants comprise of two FM researchers with postgraduate research qualification. 

Aim: This article aims to review the implementation of RCC from 2010 to 2012 and its impact on research activities 
and outcome indicators in the same period of time. 

Methods: The study comprised of two segments. Part I was a three-year retrospective review of the RCC 
administrative record. The total number of RCC sessions, hours utilised, participants' profiles, the number of research 
studies initiated by them and their research presentations at local and overseas scientific meetings/conferences 
were computed. Part 2 was an anonymous web-based questionnaire survey fielded to RCC participants to collect 
their feedback on the RCC service and their self-reported initiation and completion of research study after the RCC 
consultation. 

Results: The RCC sessions increased from 17 to 40 sessions, resulting in increment of 2 to 14 research presentations 
and from 2 to 6 initiations of new research studies per annum from 2010-2012. The response rate to the 
questionnaire survey was 70.3%, with the majority of multi-disciplinary respondents rated the RCC service to be 
accessible, adequate and were satisfied with its quality. Study design, data management and study execution were 
ranked as important areas of research for consultation. 79% of them had started a research project and 36% had 
completed their studies. 

Conclusions: The RCC is a feasible model to catalyse multi-disciplinary research in primary care institutions. Further 
study is needed to evaluate its relevance when research advances and novice researchers become experienced 
investigators to take on more complex projects. 

Keywords: Research, Consultation, Primary care 



* Correspondence: tan.ngiap.chuan@singhealth.com.sg 

Research Department, SingHealth Polyclinics Head Office, 167 Jalan Bukit 

Merah, Connection One, Tower 5, #15-10, Singapore 150167, Singapore 

2 DUKE-NUS Graduate Medical School, 8 College Rd, Singapore 169857, 

Singapore 

O© 2013 Tan et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative 
BiolVlGCl Central Commons Attribution License (http://creativecommons.Org/licenses/by/2.0), which permits unrestricted use, distribution, and 
reproduction in any medium, provided the original work is properly cited. 



Tan et al. Asia Pacific Family Medicine 201 3, 12:4 
http://www.apfmj.eom/content/12/1/4 



Page 2 of 7 



Background 

A strong primary healthcare system is vital to improve 
the health of the general population and reduce the 
healthcare burden to the nation [1,2]. Research in pri- 
mary care aims largely to seek better understanding of 
disease management in relation to the individuals, fam- 
ilies and the community, and to evaluate the effective- 
ness and efficiency of healthcare practices and health 
policies [3]. Beyond general practice and family medi- 
cine, primary care research is multi-disciplinary, cove- 
ring community nursing and pharmacy, sociology, health 
service and policy research. As primary care supports 
the base of the population pyramid and amidst a rapidly 
expanding global population, there is an urgency to scale 
up primary care research to seek medical evidence to 
prevent, cure, and care for diseases; to translate these 
evidences into regular clinical practice and to formu- 
late policies to ensure universal equity of care [4]. 

However, primary care research faces challenges, even 
in resource-rich countries, due to limitations of research 
capacity in general practice, inadequate research infra- 
structure in primary care and poor provision of support 
to individual general practitioners to conduct research. 
Saad H. Al-Abdullateef in a survey of general practi- 
tioners in selected primary care centres in Saudi Arabia 
showed that while a majority expressed interest (66%) 
and planned to carry out research (74.2%), they cited 
insufficient time (83.5%) and lack of support (58.8%) as 
key barriers to research [5]. 

Practice-based research networks (PBRNs) are groups 
of practices networked together to undertake research 
relevant to general practice and the local community's 
needs [6,7]. These PBRNs, often involving collaborations 
between practitioners and academicians, can expand the 
capacity and bandwidth of primary care physicians [8]. 
Nonetheless, these PBRNs are largely medical, whist 
nurses and other researchers tend to form their respec- 
tive research networks. Furthermore, a survey of a New 
York based PBRNs revealed that only 25% of the physi- 
cians had formal research training and 21% of them had 
clinical research certification [9]. Lack of time or com- 
peting demands for time was the top ranked barrier 
(92%) in the survey, and 80% of the clinicians reported 
that their lack of appropriate training was a barrier [9]. 
Thus, participation in PBRNs may not adequately ad- 
dress the specific research needs nor provide training for 
the individual primary care researchers; neither does it 
add impetus towards multi-disciplinary research in pri- 
mary care. 

Nevertheless, there are ample research related training 
opportunities that are available from the local academic 
institutions to equip primary care professionals with 
basic research skills. Basic research training is incorpo- 
rated in medical undergraduate education curriculum, 



and in the respective master degree programmes for 
community nurses and pharmacists who take on ad- 
vanced professional training. 

Aside from training, mentorship appears to be pivotal 
in moulding primary care practitioners into researchers. 
Curtis P et al. reported that amongst Family Medicine 
(FM) graduates who received the American National Re- 
search Service Awards, they were less successful in 
terms of research and publication output compared to 
fellow recipients such as internists and paediatricians 
[10]. The authors attributed the differences to a lack of 
protected time and sustained research mentorship for 
the family physicians. Likewise, in Israel, FM residents 
trained under pro-research mentors were likely to be 
more intensely involved in research when they became 
family physicians [11]. 

A strong and increased level of commitment from pri- 
mary care organisations is needed to provide support and 
resources and to reduce barriers for family physicians to 
carry out research [12]. Hannaford P et al. showed that a 
modest investment of resources and support will create 
substantial increases in both the quality and quantity of 
primary care research [13]. They recommended that this 
investment should be targeted at both existing primary 
care professionals working in service settings in primary 
care and those in the academic departments in the univer- 
sities [13]. Various funding models for primary care re- 
search have since been developed and implemented in 
various countries, centred largely on channelling govern- 
ment funding via FM departments in universities in 
Australia & the Netherlands, or via the Royal College of 
General Practitioners in Britain [14-16]. However how 
effective and efficient are these funding models in promo- 
ting primary care research and enhance research-related 
training for the general practitioners are seldom measured, 
and its translation into actual research endeavours are 
rarely evaluated. A new model to expedite primary care 
research in terms of effective individual coaching and effi- 
cient application is urgently needed to empower the pri- 
mary care practitioners. 

Primary care research faces similar challenges in 
Singapore, where infrastructure constraints and healthcare 
resources were hithertho barriers to its development [17]. 
However in recent years, despite the lack of dedicated 
research funding for primary care researchers from the 
local official research agencies, rapid development of aca- 
demic medicine in the local public healthcare institutions 
resulted in unprecedented support for primary care re- 
search from primary healthcare organisations, such as 
SingHealth Polyclinics (SHP). The latter comprises a clus- 
ter of nine public primary care clinics or polyclinics in 
Singapore, which is also a recognised FM training centre 
accredited by the American College of General Medical 
Education. Whilst governance, policy and finance are 
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centrally administered in SHP, the polyclinics operate at 
various sites to serve the local communities in the south- 
ern and eastern parts of Singapore using a common and 
integrated electronic medical records system. Thus in 
terms of primary care research, the institution can be 
regarded as a de-facto practice-based multi-disciplinary 
research network. 

Novice researchers from SHP can seek seed funding 
from SHP to support their approved research projects 
whilst established researchers are encouraged to vie for 
competitive research grants from national research agen- 
cies. Whilst financial support to kick-start research for 
these researchers is no longer a barrier, approval for seed 
funding is based on the evaluation of research proposals' 
scientific merits and logistic considerations. Hence novice 
researchers find it propitious to consult experienced re- 
searchers for guidance in order to optimise their success 
rates in their seed funding or other grant applications. 

With the endorsement from senior management in SHP, 
research consultation clinics (RCC) are established in May 
2010 to support budding FM researchers in the institution. 
Dedicated resources are channelled centrally from institu- 
tion annual operating budget to set up the RCC service. 
This caters to the opportunistic cost for the consultants, 
as well as the participants to meet at the RCC for free 
face-to-face consultations during clinic operating hours. It 
also provides for the seed funding for researchers to sup- 
port the execution of their project. 

Each RCC session allows at least an hour for any indi- 
vidual or group of multi-disciplinary SHP staff to seek 
advice and clarification on any issues pertaining to their 
research endeavours. During the consultation sessions, 
the topics covered include the various domains in re- 
search, ranging from exploring research idea, definition 
of research question, research method, project design, 
application for ethics committee review, logistic plan- 
ning, data analysis and interpretation to results presenta- 
tion and publication. The participants can arrange for 
multiple consultations to clarify queries for their same 
study or repeat consultation for another study. 

The RCC sessions are taken up by SHP multi- 
disciplinary staff, including doctors, nurses and phar- 
macists who plan to commence research as part of their 
professional development or are pursuing advanced 
training programmes which incorporate research as 
part of the curriculum. The service is also open to ex- 
ternal primary care researchers, including private ge- 
neral practitioners, and medical students from the two 
local medical colleges, under the over-arching objective 
of enhancing primary care research development and 
foster research collaborations between different pri- 
mary healthcare providers in Singapore. This necessi- 
tates the increase of consultants from one to two to 
manage the expanded RCC capacity. The consultants are 



FM researchers within the institution with post-graduate 
qualifications in research. 

Periodic evaluation of the service provided by RCC 
from the participants is vital to ensure that this model of 
research support remains relevant and its service caters 
adequately to their needs. This study aims to determine 
the level of satisfaction amongst the RCC participants in 
terms of their perception of the accessibility of the ser- 
vice, adequacy of the duration of the consultation, effec- 
tiveness of the consultancy, the key research areas in 
which they seek consultation, and the outcomes of the 
RCC consultation. 

Methods 

The evaluation of the RCC service comprises of two seg- 
ments. The first part was a retrospective review of the 
RCC records from 2010-2012 to determine the short- 
term accomplishments of past participants in terms of 
their research study initiation and subsequent oral or pos- 
ter presentation at academic meetings and/or scientific 
conferences. "New study" is defined as study initiated 
within the respective calendar year with reference to its 
date of approval from the institutional review board. The 
research presentations refer to investigators' presentations 
of their research findings at local or overseas scientific 
meetings or conferences which are approved by SHP. Both 
outcomes were traced from the respective databases in the 
SHP Department of Research. 

The second segment was a questionnaire survey of the 
same cohort of participants. Each participant was invited 
to undertake a web-based questionnaire survey regar- 
dless of the frequency of RCC participation. The sam- 
pling frame comprised of participants who had utilised 
the RCC service at least once and who had provided 
their email contact. The records show a list of 75 RCC 
participants between January 2010 and December 2012, 
of which email addresses were provided by 64 of them. 

The questionnaire collected data on the participant s 

1. demographic profile such as age, gender, education 
status, staff category 

2. views on accessibility of the service, 

3. quality of the consultancy, 

4. ranking of key research domains for which they 
sought consultation 

5. outcome measures of RCC in terms of initiation and 
completion of their respective research projects 

The questionnaire survey was anonymous to ensure 
truthful responses from the participants. The investiga- 
tors notified the participants of the survey via their email 
addresses. Second and third round of notices were deli- 
vered to the participants' email addresses to serve as re- 
minders to participate in the survey on the second and 
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third week respectively after the commencement of the 
first survey. 

The survey was designed using the web-based Qualtrics 
platform to field the questionnaire. The participants would 
read the study's objectives and other research-related in- 
formation according to the Participant Information Sheet 
prior to answering the questionnaire. Due to anonymity of 
the questionnaire and the minimal risk nature of the 
study, approval was obtained from the Institutional Review 
Board (CIRB reference no: 2013/253/E ) to waive the writ- 
ten consent of the participant. The data from the com- 
pleted questionnaire were imported into MS Excel for 
computation and analysis. 



Results 

The number of RCC sessions and hours increased from 
17 sessions (17 hours) in 2010, 47 sessions (48.5 hours) 
in 2011, to 40 sessions (46 hours) in 2012. The number 
of new research projects or conference presentations 
resulting directly from the investigators' participations in 
the RCC also increased from 2010 to 2012 (Figure 1). 

For the questionnaire survey, 64 email addresses from 
a list of 75 participants were found to be unique and 
currently valid. 45 of them responded to the survey, con- 
stituting a response rate of 70.3% (45/64). 39 of them 
completed the entire questionnaire, which formed the 
denominator for the computation of the results. 

Majority of participants were medical staff of SHP 
(56%), predominantly females (67%), aged 21-40 years 
(58%) and with post-graduate qualifications (49%). Table 1 
shows the demographic profile of participants in the ques- 
tionnaire survey. 

Most participants considered the RCC as accessible and 
adequate in time provision. All of them were satisfied with 
the quality of consultancy at RCC (Table 2). Study design, 
data management and study execution were ranked as 



the key areas of research for which participants sought 
consultation at RCC (Figure 2). Almost 8 out of 10 
(79%) participants had started a research project after 
RCC consultation and 36% (14/39) of them had com- 
pleted their studies (Figure 3). 

Some investigators have already started their study and 
sought consultation at RCC in the midst of their study 
execution. This accounted for the difference between 
those who indicated that they had initiated their research 
(79%) and those who have completed or in the process of 
carrying out their studies (36% + 49% or 85%). 



Discussion 

The study shows that the establishment of RCC can be a 
catalyst to facilitate research in primary healthcare institu- 
tion. It is a system approach to empower novice re- 
searchers to embark on research. The RCC serves as a 
platform for researcher-centric coaching, which caters to 
their individual or teams specific needs when they plan or 
are in the midst of executing research. Most of the partici- 
pants have undertaken basic research training at local aca- 
demic institutions. However these generic structured 
training programs may not provide answers to specific 
questions or solutions to problems encountered by the 
individual or team members during the planning or execu- 
tion stages. The RCC bridges this gap, with the consul- 
tants functioning as mentors to guide these researchers. 
Once these researchers gain hands-on experience and 
confidence after these beginners' trials or studies, it sets 
the stage for them to pursue advanced research training 
program and to take on more complex studies. 

The key elements for a successful set-up include sup- 
port from senior management to provide the appropriate 
resources, ensuring that the service is accessible and 
convenient. Adequate time allocation and quality of the 
consultancy are essential elements for successful service 



No. of oral/poster 
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no. of research 
projects initiated by 
SHP investigators 
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initiated by Non-RCC 




participants 




Number of Research Projects 




initiated by RCC participants 




Non-RCC participants who 




presented 




RCC participants who 




presented 



Figure 1 New research projects initiated in SHP and research presentation by SHP staff. 
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Table 1 Demographic profile of RCC participants 



Retrospective review of department record 


Questionnaire survey 


Demographic characteristics Number (n) Total = 64 


% 


Number (n) Total = 45 % 


Domain of work 






SHP Staff 43 


67 


33 73 


Non-SHP Staff (e.g. GP, Medical students) 21 


33 


12 27 


Gender 






Male 23 


36 


15 33 


Female 41 


64 


30 67 


Age group (Year) 






21-40 37 


58 


26 58 


41-60 26 


41 


18 40 


61 and above 1 


2 


1 2 


Education status 






l InHprnr^Hi i^fp 1? 


19 


6 13 


Degree holder 21 


33 


17 38 


Post graduate 31 


48 


22 49 


Profession 






Medical (Medical students and GP inclusive) 39 


61 


25 56 


Nursing and pharmacy 25 


39 


20 44 


delivery to the participants. Based on tneir rankings, 


the RCC consultation. Further research will be required 


most participants vaiue tne consultation in critical areas 


to understand their other unmet needs and identify 


of research, such as study design, execution and data 


other barriers that could have hindered their initiation. 


management. These components will appeal to novice 


There is also a lag 


time between research consultation 


researchers who are commencing their early phases 


and the initiation of new studies due to logistic reasons 


of research planning and execution. Nonetheless, es- 


such as application for ethics approval and lack of re- 


tablished researchers can also use the RCC service, as 


search funding. 




peer reviews by consultants serve to polish up their 


The evaluation of the research support service needs 


presentations and publications. 


to be implemented 


on a regular basis to stay relevant to 


This study is the first in the healthcare institution and 


the evolving research developments in SHP. As novice 


provides a timely evaluation of the needs of the staff 


researchers become 


more experienced and take on more 


members, who are planning or have already embarked 


complex research studies, the service will need to expand. 


on research for the past three years. However, about one 


To enhance the RCC service, additional expertise is re- 


in five participants have yet to initiate their study after 


quired to augment the small pool of family physicians 


Table 2 Accessibility, quality and perceived value of consultancy at RCC 




Accessibility to RCC 


Views of participants n = 39 


Total disagree/disagree n/(%) Totally agree/agree n/(%) 


1 can easily book a RCC appointment. 


4(10) 


35 (90) 


1 feel that the RCC, currently held on two afternoons per week are adequate 


7(18) 


32 (82) 


The venue at a centralised location in HQ is convenient. 


1 (3) 


38 (97) 


The one-hour time slot per RCC session is adequate. 


8(21) 


31 (79) 


Quality and perceived value of consultancy at RCC 


Views of participants n = 39 


Agree n/(%) 


Totally agree n/(%) 


The consultant at RCC is qualified to provide the consultation. 


21 (54) 


18 (46) 


The consultation provides the information that 1 need for my research project. 23 (59) 


16 (41) 


The consultation helps in my research. 


22 (56) 


1 7 (44) 


1 appreciate that RCC service is currently free of charge. 


12 (31) 


27 (69) 
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l Rank 1 ■ Rank 2 □ Rank 3 




Define research Study design 
question 



Study 
execution 



Data Results 
management presentation 



Publications 



Figure 2 Participants' ranking of top three key areas of research for their consultation at RCC. 



cum consultants, including biostatistician, epidemio- 
logist and bioinformatics professional A biostatistical 
consultation clinic, facilitated by a biostatistician, has 
been set up in SHP to complement the RCC in Septem- 
ber 2012. Further study will be carried out to determine 
its effectiveness in providing biostatistical support to 
the researchers. Gathering qualitative feedback from the 
consultants on the RCC service will close the evaluation 
loop in future study. 

One limitation of the survey is the failure of the inves- 
tigators to reach out to all the RCC participants. These 
include individuals who had left the organisation or 
medical students who had already graduated, resulting 
in change of their email addresses. Administrative sup- 
port will need to be enhanced to ensure that the 



participants' contacts are periodically updated, which 
may ameliorate the response rate of subsequent surveys. 
In addition, absolute and opportunistic cost of providing 
the resources in operating the RCC, including time and 
manpower, will be computed in future surveys, as the 
basis of cost effectiveness analysis. 

Conclusions 

The establishment of research consultation clinic in a 
primary healthcare institution helps to support and facili- 
tate research amongst its staff. Accessibility, convenience, 
adequacy and quality of the consultancy are key elements 
for its successful implementation. It can be measured by 
process outcomes such as the number of new research 
projects initiated and publications in journals. 



■ Yes ■ No □ Did not start 




Initiation of research project Completion of research project 



Figure 3 Outcomes of consultation at RCC. 
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